Entropy Methods in Random Motion
نویسندگان
چکیده
We analyze a contrasting dynamical behavior of Gibbs–Shannon and conditional Kullback-Leibler entropies, induced by time-evolution of continuous probability distributions. The question of predominantly purposedependent entropy definition for non-equilibriummodel systems is addressed. The conditional Kullback–Leibler entropy is often believed to properly capture physical features of an asymptotic approach towards equilibrium. We give arguments in favor of the usefulness of the standard Gibbs-type entropy and indicate that its dynamics gives an insight into physically relevant, but generally ignored in the literature, non-equilibrium phenomena. The role of physical units in the Gibbs–Shannon entropy definition is discussed.
منابع مشابه
Cross-entropy motion planning
This paper is concerned with motion planning for non-linear robotic systems operating in constrained environments. A method for computing high-quality trajectories is proposed building upon recent developments in sampling-based motion planning and stochastic optimization. The idea is to equip sampling-based methods with a probabilistic model that serves as a sampling distribution and to increme...
متن کاملADK Entropy and ADK Entropy Rate in Irreducible- Aperiodic Markov Chain and Gaussian Processes
In this paper, the two parameter ADK entropy, as a generalized of Re'nyi entropy, is considered and some properties of it, are investigated. We will see that the ADK entropy for continuous random variables is invariant under a location and is not invariant under a scale transformation of the random variable. Furthermore, the joint ADK entropy, conditional ADK entropy, and chain rule of this ent...
متن کاملSpectral Dimensionality Reduction via Maximum Entropy
We introduce a new perspective on spectral dimensionality reduction which views these methods as Gaussian random fields (GRFs). Our unifying perspective is based on the maximum entropy principle which is in turn inspired by maximum variance unfolding. The resulting probabilistic models are based on GRFs. The resulting model is a nonlinear generalization of principal component analysis. We show ...
متن کاملMHD Natural Convection and Entropy Generation of Variable Properties Nanofluid in a Triangular Enclosure
Natural convection heat transfer has many applications in different fields of industry; such as cooling industries, electronic transformer devices and ventilation equipment; due to simple process, economic advantage, low noise and renewed retrieval. Recently, heat transfer of nanofluids have been considered because of higher thermal conductivity coefficient compared with those of ordinary fluid...
متن کاملSmall Deviations of Gaussian Random Fields in Lq–Spaces
We investigate small deviation properties of Gaussian random fields in the space Lq(R N , μ) where μ is an arbitrary finite compactly supported Borel measure. Of special interest are hereby “thin” measures μ, i.e., those which are singular with respect to the N–dimensional Lebesgue measure; the so–called self–similar measures providing a class of typical examples. For a large class of random fi...
متن کاملA Unifying Probabilistic Perspective for Spectral Dimensionality Reduction: Insights and New Models
We introduce a new perspective on spectral dimensionality reduction which views these methods as Gaussian Markov random fields (GRFs). Our unifying perspective is based on the maximum entropy principle which is in turn inspired by maximum variance unfolding. The resulting model, which we call maximum entropy unfolding (MEU) is a nonlinear generalization of principal component analysis. We relat...
متن کامل